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A  model  is  defined  wherein  corrective  action  may  be  accounted  for  in  im-  ;j? 

'  .  proving  the  estimation  of  reliability  over  the  usual  nominal  success  ratio.  i 
Probabilities  for  correcting  any  one  of  K  failure  modes  which  may  arise  are  % 
assumed  known  within  the  structure  of  a  multinomial  sampling  procedure .  Mean  i 
reliability  is  defined  as  a  function  of  the  unknown  probabilities  attached  to 
|  the  failure  modes,  the  problem  being  to  estimate  this  mean.  Other  measures 
of  current  reliability  are  defined.  Three  different  estimators  of  mean  relia¬ 
bility  are  defined  and  analyzed  from  the  point  of  view  of  unbiasedness  . 

Explicit  expressions  for  the  bias  are  derived  and  compared  numerically  for 
a  wide  variety  of  choices  for  the  unknown  parameters .  Several  problem 
.  r’  areas  for  further!  research  are- identified  and  partial  formulations  of  some 
v  of  these  are  discussed .  f\  • '  v>.  *y.  .  !  i  ' 
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1 .  Introduction 


A  problem  of  considerable  importance  in  current  reliability  studies  is 


that  of  accounting  for  changes  in  reliability  that  result, horn  various 


*£  actions  designed  to  modify  a  part  or  a  system.  Such  modifications  may  • 
iJ*  range  from  design  changes  in  the  early  states  of  development  to  corrective 


action  taken  to  remove  modes  of  failure  that  habe  been  pl^rved  in  a  test- 


111  lift i:Jt  f ;vv,v ■'  ing  program  at  a  later  stage  of  development. .  Any  iSoJ^fwhich  it  Is 
j  %  }:*:i  ,  assumed  that  such  modifications  never  decrease  theiteliaftftlty  (probaba  - 

’!  'f  i;  V  !:  |  Ability  of  successful  operation)  has  come  to  be  titled  ’'reliability  growth ." 

J  il  l u  Despite  the  importance  of  the  problem  and  the  Interest  In  solutions  # 


U  ^  „„r  w,  „..WT  r_ _ ____  •••W  _ _  I.  UBWU.l,  J 

'  Cf  r  very  little  published  research  on  the  topic  of  reliability  growth  exists .  A 

»|  . ....  ■ 

i i  ■  brief  list  of  some  papers  on  the  subject  is  given  in  the  bibliography.  In 

f  '  y'  l'if  one  reference  [3]  the  Writer,’  along  with  others,  has  developed  one  model 
I ; .  'fi-lf'  to  account  for  reliability  growth  and  several  estimations  problems  are  dis 


:  {■  .  oner  nst  ox  some  papers  on  xne  suojeci  is  given  in  me  oionograpny .  in 

jrj  •'  tj  %)'.••&  \  .  '  1  •  i  :  '  •  •  . 

i'f  \  .v‘  :- one  reference  [3]  the  Writer,’  along  with  others,  has  developed  one  model 


!  •  •  t  :'A  V*'*'  {•*  V s- -v  *Y 
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to  account  for  reliability  growth  and  several  estimations  problems  are  dis- 
cussed  there  ,  This  same  model  is  the  main  concern  of  the  present  report  V 
and  is  repeated  here  for  the  sake  of  completeness .  . 


Suppose  that  an  item  or  a  system  is  to  be  tested  and  each  test  may 


;i  iP J  1-  "redult  in  success  with  probability  p  or  exactly  one  ofLjC,' 'fixed ,  but 

■:  i ).  I  ; :}  Mti*?  otherwise  unspecified ,  modes  of  failure .  The  parametsjr  •  b  is  referred  *■ ; 

W/* '■“>!!  filfi-'  5'!  fn  jib  fhA  {niHiil  itnf)  Wa  Hmntfi  tha  rtmmKilih/  nf  fkilnra.A1 


A f'j  f  v  }j  to  as  the  Initial  reliability  and  We  denote  the  prob 

•'?4'  '  ';!!r1v;  .iiby  q.  forl«l,.2,  ....  K.  Thus,  p'-f  I  l«l 


of  failure,  of  type  / 

v/’  '  •  : 


"V-i>  • 


and  if  we  assume  that 


•  •  i  •  rv  t  vv»  v 


N  fixed,  mutually. Independent  tests  are  to  be  performed ,  the  underlying  • 


probability  model  is  that  of  the  multinomial  distribution  with  parameters 


N,  p  ,  q1#  .  . . ,  qK .  Accordingly,  we  denote  the  number  of  Observed 
;  '<■  w  '  •  successes  in  N  tests  by*  N  while  N,  is  used  to  denot 

m.  observed  failure^  of  type)  I,  Thus,  N  >  N* ,  N,.  ar 

1  ’■  ji* .  1  .  v:.  '  * >/;?*•  '.y  w 


enote  the  number  of  observed  J 

•  ■  .  ,  *  •  •  ,  ■  ■  •  ■;  .,  ■’  ;y,.,*  •  '• 

is  used  to  denote  the  number  of  y  iv 

•  ..... 


are  (marginally) 

1  1  V'v  ■■ 


.  M  •  "  r if.; j  :r . 

Ml:  y  ,dr*?V. 

f  ; ,  !  *  i- 


;  binomiai  randonl  variables  , subject  to ^the  restriction^  £  N:  w  N  i  j ; 

b-  ■:  .  •  Mo. ••:..*  M ■’<.  )•:  ••  f.!!/;  ■  v : .  •  - 

•*,  tr  *  '  fj.  K.M-i. .  -  V*.  •  U »<•  ...I  w  .  .  r  «  .  *i  ■»  7  V  ’  •  ■  *  !• 
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By  fixing  K  in  the  preceding  formulation  it  is  tacjfly  assumed  that 


•  *  My* 

no  new  failure  modes  are  ever  introduced •  Also,  it  is  assumed  that  no 

ft** 

corrective  action  is  to  be  taken  until  all  N  tests  are  performed  so  that 


our  procedures  will  be  based  on  fixed  sample  size  experiments  •  Having 

'■  * 

performed  N  iepts ,  it  is  assumed  that  each  observed  failure  mode  can  be 
;  classified  as  to  type  and  that  ah  attempt  is  then  made  to  remove  that  mode 

%  *  ,  ‘  .  i  *  » 

of  failure.  However,  it  is  not  assumed  that  a  failure  mode  is  necessarily  ^  : . 
v:  ;  ;  $  «  v 

removed  once  it  is> observed .  Indeed,  subject  to  experience  with  the  item  w  / 

^  or  system,  it  is  assumed  that  there  Is  a  known  probability  a.  of  removing 

•  th  * 

the  1  mode  of  failure  given  that  corrective  action  is  taken  which  in  turn 

is  always  taken  if  and  only  if  the  failure  mode  is  observed . 

Under  the  above  model  ,  thhre  are  at  least  three  measures  of  current 

'  reliability  that  are  of  Interest  each  being  appropriate  at  possibly  different 

.  *  *  «  »*  * 

stages  of  development.  First,  and  the  most  natural,  is  the  actual  current 

f  :  .  .  .  .  '  "  .■  •  ’•  ; 

reliability,  say  R  ,  which  exists  after  the  tests  and  afteij  the  corrective  ^ 

^  action  takes  place .  Prior  to  testing,  R  is  a  random  variable  of  course  and  *  ' 


•  1  H  f  t 
> 


may  be  written  as  follows*  Let  y  “  1  if  N  >  0  and  0  otherwise,  so  that  y.  , 

•  •  11  .  ^  1 

is  a  random  variable  that  accounts  for  whether  or  not  tl^e  i  failure  mode 

occurs .  Also,  let  x.  *  1  if  corrective  action  on  the  i**1  failure  mode  actually  " 
removes  that  mode  of  failure  and  0  otherwise ;  We  may ,theh  write,  ,  > 

*  ‘  l  >  •  ,1  ’  i  •  J  »*•.  r\  • "  J  •  *  ,i  .1 . 4  k*  ;\  *  •  4  t'  r  .  '»  •  J*l*  V 4  '  .  -t  fY  '  a  ‘  v  *  .  ,  *  ^  f  •  • 

*  .  ■  ‘  *  '••!■  '  •  »**  1  »../■  **  \  .t,*  •  1  n,  *  -| 

*  *  •  ,1  •  I  mm  \  .  -f4  '  •  ,•  *•  1.  V  .  ^  • 

••  -V  •  v;..*  .  K*  •  r; :  '•  "i"  f-' ■ 

;  ■■■ . 1  ’  ■■  V+  LWi 

•  ■ '  -.r/v 
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In  this  form  we  see  that  current  reliability  is  the  initial  reliability  plus  |#  ; 
any  failure  probability  that  has  been  observed!  and  actually  removed . 

Reliability  is  thus  not  increased  by  a  particular  mode  if  either  it  Is  not 
observed  or  it  is  .observed  but.  not  removed V v .  iijL  •"  ’4;  ‘  «•  •  ‘ 

■  ! . .  ■  >, )"  .-I  .  -'is,.  -rt-- . ‘i  •;  t  •’./  :>’!■<''  V.-'*':'*.". ;r:*,  ;•  -u-.'-  .  t.  ^  ‘v  i.  *•,  •  ;  .! 
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;  • '  v ,  f  \  \  ,m  Vv:  *  v».v-.  *.»••  1  W.  «  •  ••  f  .J*  • 

•  .  i  ..  •.  *  *'  '  v  »  ■'  .i  •  *  i!  •’  •.  r  :  ■  !  ,*'•* 

‘  •  •  •  ,  •  .  -  V.  .  ••  v*  *'  «v  %  '  .  \  \  »■, 

1  I*  'iivi  i*  *"|  *,  /  *1 M  it  •*  1  ,  •  v j  i  1  ‘  *  '  •  y  *  *  *  '  *  *  •  ^  •  *■'  ■?  *  ,  , 
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..  . ,  Th^quantity  R  which  we  have  defined  above  is  of  prln||ry  interest 

li  after  %Ke  complete  testing  program  when  the  actual  current  ^lability  is 

<  V  jf^t,  ,  .;V  '  ‘  ^ 

•  :V.  *  (>••• 

!(■>  1  r> •<  v:  ..  • 


■t 
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desired.  One  perfectly  straightforward  way  of  estimating  fy7|s  to  perform 

N  additional  tests,  observing  N  successes  and  use  the  usual  success 

i  o 


i 


ratio  N  /to  as  an  estimate.  It  this  is  feasible ,  such  a  procedure  certainly 

o  .  i 

is  on  safe  grounds  statistically  speaking .  If  ».  however,  the  cost  or  availa¬ 
bility  of  items  prohibits  this  direct  Approach,  it  is  necessary  to  adopt  a  ,• 

•  *  < .  ‘  ,  *»  '  v.  *  t .  "  •' 

cruder  measure  of  current  reliability  and  use  the  results  of  the  N  tests  to 
draw  Inference  about  the  amount  of  reliability  growth ,  One  such  measure 

•  „  •  .  i  #  ,  *  •  .*  . 

would  be  the  conditional  mean  of  R  ,  conditioned  on  the  observed  values 
of  N. ,  1*0/ 1,  . . , ,  K .  This  conditional  mean ,  denoted  p  *  is  derived  in 

i  ■  *  :  •  i  - '  .  .  •  *  ■  •  -i  ->0,  • 
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i  .^  vf ;  >  >.  %  [  3]  and  is  given  by  1 

Hn&K*  jUUMj*  •  v-r^V. 

'.vCd'*£ :  \  K'.:" 

t : *  v  JV V- 

•  .A  p:<  •?  .  1  ■>  * 

i.  . ;  •i-JJ.vM  •  •  ,  •  -t 

/  5*  .  >  ;>  •  . 

(  •  ;  ■  (.w  •. 

•  t  t  :>■  "Y-\rV  . 
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p. where 'y; -'Is  ( 


2)  P, 


•  : 


po  + 


K 

iwi 


i-i 


defined  above.:  Such  an  average  has  an  advantage  in  that 

.  4  *  •  .  •  .  .  • ;  ..  . 

:  y'’-£  averaging  is  taken  with  respect,  to  whether  or  not  corrective  action  is  sues 

ivild:.'  :•  '  ' .  ‘ 


*Hh 


•|i 

ii-|p  - 

.!  ?.(';!  1  ii  .  t 

i  •  il  tin  ai 
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ij  ,  cessful  as  a  function  only  of  the  failure  modes  that  are  observed .  In  this  Mi 

:  .  .  $  . 

sense;  p  is  not  the;  true  current' reliability,  that  is  success  probability,  • 

,  ]  as  it  is  erroneously  referred  to  in  [2]  but  is  already- an  "average"  rella-  l'J- 


bility.  The  analysis  of  both  R  and  p_  is  the  main  concern  of  Report  No .  2  v 

*  *  •  •  •  D.  . 
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!>i  iijT-i|'kof  this  study  [5]  and  will  not  be  discussed  'further  in  this  report.  '  :  ) 


f  •*  'fl  ,  . ;  i 


A  third  measure  of  current  reliability  is  the  unconditional  mean  of  the 

* 


I  :  ii  !  ■';',:'  an  "average"  taken  over  all  possible  outcomes  of  the  experiment.  This 


!.  -t;'!  ,;  current  reliability  (which  is  the  same  as  the  expected  value  of  p  )  and  is 
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i;Y\  measure  pf  reliability  is  relevant  before  testing  and  before  corrective  action., 
quantity  would  be  suitable  for  assessing  the  potential  gain  in  relia¬ 
bility  to  be  derived  from  a  corrective  action  program  .  Being  a  true  parameter 
in  the  strict  sense  of  the  word,  it  lends  itself  quite  Well  to  standard  statis- 
tical  estimation  tools »  It  is  shown  in  [3]  that* this  tnean  reliability,  denoted 

i  .  :  ; 

p,  is  given  by  the  formula , 
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(1.3)  li  =  P0  +  l  ajQj-  l  aft  (l-Qj)” 
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References  [2]  and  [3]  address  themselves  mainly  to  ^ie  problem  of  find¬ 
ing  estimator^  for  p  under  the  conditions  stated  in  the  above  model . 

•;  .  i 

Several  estimators  are  defined  in  both  references  and  various  properties 

(of  both  a  positive  and  a  negative  nature)  are  discussed.  Three  of  these  * 
are  of  interest  in  the  present  study  and,  fo?  the,  sake  of  definiteness,  the 
notation  of  [3]  (which  does  not  always  agree  with  tit  of  [2]  even  for  the 
same  quantity  will  be  adopted . 


V 

>  A 


1  ■' 


The  maximum  likelihood  estimator  for  p  is  denoted  p^  and  is  defined 


' 

.X  . 


quite  simply  by, 


(1.4)  p,  -5>  +  f  ./it  f 

3  N  k  1  F  £,  1  N  J 

I,  •  ••  •.  • 

*  ‘  ,  *  '•  1  - 

An  exact  expression  for  the  expected  value  of  p,  was  not  available  in 

[3]  although  approximate  expressions  were  derived.  This  created  some 

■  .  ,  .  ■  •  •  '  ;  '  •  ‘  ■  :'■  •••"  A. 

limitations  in  comparing  p.  with  other  estimators  on  an  equitable  basis .  /  ■ 

3  •  •.  _  *  A  ' 

One  of  the  purposes  of  the  present  study  is  to  resolve  this  problem  of  . 

t  .  '  •  *  «  .  .  t 

exact  expressions  for  the  moments .  The  results  are  presented  in  the  H 
sections  to  follow. 


•  •  •  ;;v  •  »  i*.  ,  • .  ’ 

Another  estimator,  derived  in  [3]  to  meet  the  requirements  of  unbiased^ 


M  5*  -  f  .  • 


ness,  is  denoted  p_.  and  is* given  by  the  expression, 
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The  corresponding  bias  of 
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simply  by 


as  of  p5,  defined  by  b(p5)  ;  -  ;  E(pJ -p  is  given  quite  *, 
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It  should  be  noted  that  p.  Is  not  unbiased  and,  indeed,  It  is  shown  in 
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[3]  that  no  unbiased  estimator  for  p  exists.  However,  the  bias  for  p, 
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may  be  so  small  as  to  be  negligible  and  this  will  be  Verified  in  Section  3 
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to  follow . 
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"2.  i  i '  For  reasons  peculiar  to  the  Navy  ,  a  third  estimator  for  p  has  been 
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estimator  is  here  (and  in  C  33)  denoted  by  pe  and  is  defined  by, 
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.  -  It  should  be  observed  that  the  bias  of  pe  is  always  negative  so  that  p. 
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is  a  "conservative"  estimator .  However,  it  may  be  that  the  amount  of  bias 
is  serious  enough  to  discredit  conservatism  in  some  cases  . '  Several  samples 
admitting  a  wide  variety  of  choice  for  the  various  parameters  in  the  above  ; 
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model,  are  delineated  in  [2] .  However,  a  simulated  version  of  the  random 
variable  pM  is  used  as  a  reference  point  rather  than  u  ,  no  results  regards 
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Ay,’  lng  p.  are  presented  and,  for  .reasons  mentioned  previously,  the  moments 


-  ; I;  of  p4  are  omitted  from  discussions  .  An  examination  of  the  behavior  of  all 
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2  •  Maximum  Likelihood  Estimator 
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'S  One  of  the  common  features  of  the  two  estimators  p_  and  p..  defined 
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in  Section  1  is  that  no  credit  is  given  to  failure  modes  that  occur  only  once; 
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This  is  easily  seen  by  examining  equations  i;$  and  1.7  where,  if  N.^) 
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for  any  given  1,  that  term  involving  N,  vanishes  and  therefore  does  not 
h.  affect  the  value  Cf  the  estimator  ;  >F<fr  small  sample  sizes,  this  is  Somewhat 
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u‘MrX  The  bias  of  p.  is  then  Immediate  and  may  be  written  as, 
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k  Before  examining  the  magnitude  of  the  bias  bCp^)’ ^n  comparison  with  other 
:  ] |1  eitlmator* ,  it  la  po$«ibl«  to  provide  an  alternative  form  of  (2 .1)  tiling 

■  ■  ■■  ■  !  Mil >.  I  1  !■;  •  vM . 

viJ'?..  *1*  lU  *  h  !*’  .  i  C  )  ‘  ‘ !*  1  .  ’  ; 


Stirling  numbers  of  the  second  kind .  This  form  may  be  more  appropriate 

for  some  purposes  than  the  one  given.  As  before*  finding  E(pJ  reduces 

til  ^  m  ‘  ^ 

to  being  able  to  write  the  general  m  moment  of  the  binomial  distri¬ 
bution  explicitly.  The  expression  of  the  latter  in  terms; of  Stirling  numbers  ». 
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does  not  seem  to  be  widely  recorded  and  is  stated  below  as  a  theorem  for  .  .  t!  • 
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the  record.  Wit£  regard  to  the  proof#  we  follow  the  notation  of  [4]  so 
that,  for  positivi  integers  k  and  r,  k^-  k(k-l)  ---(k-H-l)  “*j£g  if 
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Returning  to  the  bias  of  given  in  (2.2)  it  is  difficult,  because  of  the 
complexity. of  the  expression,  to  make  general  statements .  Certainly  p. 
may  both  overestimate  as  well  as  underestimate  p  .  A  simple  example  ' 
shows  this .  Suppose  N=2,  K“l,  and  a^-1.  Now,  if  q(‘~.9,  then  p^^l 
while  if  Qj  ■  .1  then  p  ■  .919 .  In  either  case,  .E(p^)  |s  given  by  .975 

so  that  in  the  first  pase  (p.  *  .9) ,  b(pj .«  -  *016  and  in  the  second  case  * 
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+  .066.  More  cases  are  treated  in 'the  next' section. 
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3 .  Numerical  Comparisons 
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To  gain  further  Insight  into  the  results  pf  the  last  s option  as  well  as 
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to  compare  these  results  with  those  previously  obtained  in  [2]  and  [3], 
it  was  decided-to  examine  special  cases  numerically  .  Vor  this  purpose 

'  •  •  •  ■.'  >  if 

the  examples  documented  in  [2]  were  used.  Such  examples  allegedly 
cover  a  wide  variety  of  cases  that  are  of  practical  significance.  The  tabu* 

lated  results  may  be  found  in  the  appendix.  Section  5\  An  example  is  de- 
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fined  by  specifying  the  parameters  K,  p  •,  q. ,  q9,  . Nine  such 
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specifications  are  given.  However,  in  each  example,  the  parameters 

a. ,  a_ ,  . .  a.  as  well  as  N  are  further  specified  to  provide  fifteen 
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cases  in  all.  In  reality,  then,  135  examples  are  treated  in  the  appendix.; 
For  each  of  these  examples  p,  the  moments  of  each  of  the  three  estimatop  . 


In  addition, 
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p. ,  p_,  p.  are  recorded  as  well  as  the  bias  in  each  case 

3  5  b  v  r 

the  value  of  p  determined  by  computer  simulations  in. [2]  is  given  for 
each  example  . 

*  ;• 

We  previously  remarked  in  Section  1  that  pQ  ,  the  conditional  mean  of 

the  true  current  reliability  is,  prior  to  the  experiment,  a  random  variable.  > 

.  4t 

Even  after  the  experimental  results  are  known,  moreover,  the  value  of  p 
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8 till  cannot  be  determined  because  of  the  unknown  parameters  p  ,  q .  , .  .  .  ,q„ 
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which  enter  explicitly  in  its  formula.  It  is  shown  in  [3]  that  the  variance '! 
of  p  converges  to!  zero  as  N  becomes  infinite*  Hence,  for  large  N, 
the  values  of  p  (Whatever  the  experimental  outcomes)  and  p,  its  mean  / 
should  not  be  significantly  different^  The  tables \6t  Section  5  show  that 
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these  two  quantities  differ  by  very  little  even  for  moderat^  values  of  N->- 
at  least  for  the  examples  treated.  What  this  means,  of  course,  is  that 


any  estimator  wp  choose  for  estimating  u,' a  parameter,  can  effectively 

★ 

be  used  also  as  a  predictor  for  p  ,  a  random  variable .  / 


,V  r 


As  for  the  maximum  likelihood  estimator,  p.,  the  tables  reveal  that 
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the  bias  is  positive  in  practically  every  case  investigated .  In  some  cases 
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Examples  3  through  8,  the  amount  of  positive  bias  is  serious  enough  to 


make  its  use  doubtful.  Of  course,  we  are  speaking  h< 


[y  of  unbias  ed- 


*  ’ !  ness  as  a  criterion  for  choice .  Recalling  the  original  proBlem ,  one  is 
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attempting  to  take  credit  for  corrective  action  in  updating  reliability  over 


.  the  initial  state  of  nature  pQ.  Positive  bias  indicates  a  tendency  to  take 


*  "  /  more  credit  than  is  due  and  such  optimism  can  be  very  misleading  as  to 
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the  potential  worth  pf  such  a  testing  program.  From  this  point  of  view,  p. 


has  little  to  offer  the  experimenter.  The  result  is  not  too. surprising  since 
maximum  likelihood  estimators  tend  to  be  biased.  Moreover ,  it  is  difficult 


\  to  justify  the  maximum  likelihood  criterion,  for  which  p^  is  the  optimal 
choice,  as  one  to  adopt  in  the  present  circumstances. 


As  far  as  unbiasedness  alone  is  concerned,  it  is  here  reiterated  as  in 


[3]  that  p.  is  "effectively"  unbiased.  Indeed,  in  every  single  example 


treated,  the  bias  of,  pg  is  zero  to  three  decimal  place  computation .  Not 
one  case  arose  where  the  result  was  different  hnom  zero.  Such  a  situation 
is  not  surprising  for  large  values  of  N  as  brought  out  in  [3]  but  for  small 
values  of  N  the  same  result  is  somewhat  surprising  and  helps  support  pc 
as  an  important  contender  for  use  as  an  estimator  for  ^  , 

It  was  anticipated  that  pg  would  underestimate  \x  since  it  was  defined 
in  such  a  way  as  to  have  this  property.  The  amount  of  bias,  is  somewhat 
serious  in  several  of  the  examples  (notably  1,  2,  4,  and  8)  •  As  remarked 
previously,  the  price  for  conservatism  may  be  to  high.  Certainly  we  wish 
to  avoid  overestimating;  at  the  same  time  we  shmuid  not  want  to  be  unduly 


severe  so  that  we  certainly  wislfco  fake  credit 


corrective  action  when 


such  credit  is  due. 
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As  a  final  remark  we  note  the  following  interesting  result  in  the 
examples.  As  the  a^'s  decrease,  it  is  noted  that  for  fi^ed  N,  the  bias 
approaches  zero  (from  either  side) .  This  means  that  as  our  ability  to 

.  *1*,  , 

remove  the  cause  of  a  detected  failure  decreases  so  too  our  tendency 
to  overestimate  (or  underestimate,  as  the  case  may  be)  decreases. 
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4 .  Topics  for  Further  Study  . 

It  is  concluded  that  the  matter  of  unbiasedness  for  the  model  treated 

.  !  „  -  . 

in  this  report  is  settled.  P_  is  preferable  to  the  three  estimators  ex- 
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amined  and  certainly  p3  should  be  rejected  on  this  basis  ,  However  ,  '.|l- 

£s  previously  remarked,  unbiasedness  is  but  one  criterion.  It  is  well 

known  that  a  biased  estimator  is  preferable  over  an  unbiased  one  if  the 

variance  of  the  former  is  sufficiently  smaller  than  that  of  the  latter.  This 

suggests  adopting  mean  Squared  error  as  a  criterion  and  comparing  p^, 

p_  and  pc  on  this  basis . 

0  0 

In  [3]  the  .variance  for  pc  has  been  derived  and  is  given  explicitly 

o 

at  least  up  to  higher  order  terms ,  No  such  expression  is  yet  available 

for  p.  although  some  (umpublished)  computer  simulations  canted  out  in  con- 
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nectlon  with  [3]  indicate  that  the  variajice  0f  pg  debases  rapidly  with 

N.  Clearly,  the  variance  for  p.  can  bewfitten- dowrfalong  the  lines  of 

A  • 

the  first  moment  as  derived  in  Section  2  although  the  f  tyebra  Involved 

,’T 

may  be  somewhat  unwiedly.  In  any  event,  numerical  Values  can  certainly 


be  obtained  for  such  as  the  examples  treated  in  this  report.  With  such  tools 
at  hand,  the  three  estimators  could  then  be  compared  on  a  mean  squared* 

*  i 

error  basis. 

Since  p  is  a  well-defined  function  of  the  unknown  parameters  involves, 
another  problem  suitable  for  investigation  is  that  of  finding  a  Bayes  estimator 
for  p  •  Some  a  priori  assumptions  about  pq,  q^,  qR  would  of  couri|ie 
have  to  be  made  and  the  results  judged  accordingly.  Such  an  estimator  should 
then  be  competed  with  the  other  candidates  as  to  unbiasedness^  mean  squared 


error,  etc. 


:>  i  > 


l 

I 


.1  * 

p:u... 

V*  t  .  , 

Vi l 
fr'i'A:  :,:• 


,« , .. 

i  . 

v  t.. 


i'Uj  ■'  1-iU'.  £.'?•*■ 

*  “  ■'  ■;  i',  [ 

■•  ;  ‘  ■■  !  MV  .*•'■  « 

V,'  ’ 

•  .  ’ WT  .  *  .  m 


-V-.y' 

rV>  . 

■ 


W. 


As  yet,  little  progress  has  been  made  within  this  model  in  the 

»  ■ 

direction  of  confidence  interval  estimation.  In  no  small  part,  this  is 
due  to  the  complete  lack  of  distribution  theory  with  regard  to  the  esti- 
mators  treated.  It  would  be  most  desirable  to  study  the  problem  of  find-* 
ing  a  lower  one-qided  confidence  interval  for  u  .  Even  approximate  re¬ 
sults  would  be  beneficial  to  the  present  state  of  the  art. 

Still  another  problem  worthy  of  investigation  is  a  re-examination 

*  '  .  •  *.<.•  .  .  .  ji  .  , 

of  the  model  itself.  In  spite  of  its  reasonableness,  sflme  aspects  of  the 


model  are  somewhat  confining.  Most  notably,  the  ma|J|j^*pf  allowing 
failures  to  accumulate  until  all  N  tests  are  performed  ifta^>e  intolerable  '4/ 
in  some  practical  situations .  It  may  be  far  more  reasonable  to  stop  test-  1  *{v. 
ing  as  soon  as  a. failure  is  observed/ take  the  necessary  corrective  action/  ,\  v, 

■  •  /  •  •  *.•  ,  •  M,.,  : 

then  proceed  as  before  until  the  next  failure  occurs .  Such  a  program  of 

■  .  .  -i.  ;  ■■ 

testing  would  thus  involve  several  stages .  In  a  given  stage,  the  sample 

•  •  •  i  * 

obtained  would  be  a  sample  from  a  geometric  distribution  (having  observed 
Bernoulli  trials  to  first  failure)  but  the  parameter  changes  from  one  stage 

to  the  next  if  corrective  action  is  successful.  Again,  various  quantities 

•  '•  ) 

related  to  the  growth  in  reliability  could  be  examined  Under  this  model. 

A  model  similar  to  that  just  outlined  is  presented  in  a  report  [1] 
which  appeared  recently  in  the  literature.  A  brief  examination  of  this  re-  • 
port  reveals  several  shortcomings  which  will  need  to  be  overcome  before 
the  usefulness  of  the  results  can  be  assessed.  In  any  case,  the  work  pre-'Y- 
sented  there  should  be  more  closely  examined  if  further  study  along  the 
lines  presented  above  is  pursued  •  .  % 


5.  Appendix 

The  tables  to  follow  summarize  the  numerical  results  which  are  analyzed 

.  “  i  „ 

in  Section  3 .  The  tables  are  self-explanatory  with  all  of  the  notation  con¬ 
sistent  with  that  previously  adopted  in  this  report.  The  examples  were 
limited  to  those  available  in  [2]  in  order  to  avoid  computer  simulations 
needed  for, evaluating  pQ  •  Otherwise,  any  number  of  further  examples  may 
be  defined  as  in  the  tables  and  the  corresponding  entries  easily  computed . 
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